
TITLE OF THE INVENTION 
IMAGE PROCESSING APPARATUS AND METHOD 

FIELD OF THE INVENTION 
5 The present invention relates to an image 

processing apparatus and method and, more particularly, 
to an image processing apparatus and method for 
rendering an image on the basis of a rendering command. 

10 BACKGROUND OF THE INVENTION 

Upon outputting a high-quality image based on 
image data via a printer or display, a plurality of 
objects that form the image must undergo color 
processes such as color correction, color conversion, 

15 binarization, and the like in correspondence with the 
types of objects. 

In general, upon printing or displaying on a 
display device an image created by application software, 
rendering commands from the application software are 

20 imaged by a device driver (or device itself) of a 

printer or display device to create image data to be 
printed or displayed for the entire page. Rendering 
commands that form a document include, e.g., an image 
rendering command corresponding to a photo image 

25 portion, a text rendering command corresponding to a 
text portion, and a graphic rendering command 
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corresponding to a graphic portion. Such rendering 
commands are issued to the device driver, which execute 
color processes suitable for individual objects in 
units of types of commands, thus converting the 
5 commands into an image that an output device can output. 
Upon conversion, color matching processes are 
switched so that graphics, text, and photo portions 
respectively undergo "saturation", "colorimetric" , and 
"perceptual" processes, and an image in which all 

10 objects on the entire page have high image quality can 
be obtained. 

In recent years, some system or application 
software designates a "source color space" of each 
object, and the device driver can obtain a high-quality 

15 output image using the designated contents. For 

example, when a scanner input image is pasted onto a 
document, the image rendering command of that image can 
designate a color profile which describes the device 
characteristics of a scanner, or a color profile that 

20 describes the characteristics of a monitor used to 
reproduce colors observed by the editor upon color 
calibration on the display. Such color profiles are, 
for example, International Color Consortium (ICC) . 
profiles, and Image Color Matching (ICM) of Windows®95 

25 available from Microsoft Corp., ColorSync of Apple 
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Computer, and the like are known as systems that can 

use such profiles. 

In order to implement the aforementioned image 

processes, upon printing even an image that the user 
5 recognizes as a single image, application software or 

an operating system often issues .a plurality of 

rendering commands. In this case, whether or not 

rendering commands corresponding to a plurality of 
Q segmented images can be combined is checked by 

SJ 10 comparing apex coordinate information of rectangular 

jr regions as rendering regions of the respective 

%j rendering commands corresponding to the plurality of 

segmented images, as described in Japanese Patent 
f7 Laid-Open No. 2000-13622. 

f 5 ^. 15 For example, as shown in Fig. 1, when one image 

Jjf is issued as two image rendering, commands, since the 

lower left apex of rectangular region 1-A of the first 
rendering command neighbors the upper left apex of 
rendering region 1-B of the second rendering command, 
20 and the lower right apex of rectangular region 1-A also 
neighbors the upper right apex of rectangular region 
1-B, it is determined that images to be rendered by the 
two rendering commands can be combined. 

Recent application software normally has a 
25 function of cutting image data into an arbitrary shape. 
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When an image cut using this function is to be printed, 
a plurality of image rendering commands are issued. 

For example, as shown in Fig. 2, these image 
rendering commands are issued to be segmented into 
5 rectangular regions 2 -A, 2-B, 2-C, 2-D, and 2-E. When 
the image is segmented, as shown in Fig. 2, the 
aforementioned method of checking by comparing apex 
coordinate information of these rectangular regions if 
rendering commands corresponding to a plurality of 

10 segmented images can be combined cannot determine 

whether all five image rendering commands corresponding 
to these cut (segmented) images can be combined. For 
this reason, these segmented images cannot undergo an 
identical correction process on the basis of the 

15 characteristics (e.g., color distribution) of an image 
that the user recognizes as a single image, and an 
image with poor image quality is obtained in place of 
that with high image quality. 

2 0 SUMMARY OF THE INVENTION 

The present invention has been made to solve the 
above problems, and has as its object to search for a 
plurality of objects obtained by segmenting a single 
image . 

25 In order to achieve the above object, a preferred 

embodiment of the present invention discloses (claim 1) 
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It is another object of the present invention to 
determine correction characteristics of the single 
image on the basis of the characteristics of the 
segmented objects when the segmented objects are found. 
5 In order to achieve the above object, a preferred 

embodiment of the present invention discloses (claim 
1 + 2) 

Other features and advantages of the present 
invention will be apparent from the following 
10 description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 
the same or similar parts throughout the figures 
thereof . 

15 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a view for explaining an example of an 
image segmented into two image rendering commands; 

Fig. 2 is a view for explaining an example of an 
image segmented into a plurality of image rendering 
20 commands; 

Fig. 3 is a block diagram showing the arrangement 
of an image processing apparatus according to an 
embodiment of the present invention; 

Fig. 4 is a flow chart showing the process 
25 executed by a printer driver shown in Fig. 3; 
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Fig. 5 shows the default state of an 
identification table ; 

Fig. 6 shows an example of the state of an 
identification memory; 
5 Fig. 7 shows an example of the state of the 

identification table; 

Fig. 8 shows an example of the state of the 
identification memory; 

Fig. 9 shows an example of the state of the 
10 identification table; 

Fig. 10 shows an example of the state of the 
identification memory; and 

Fig. 11 is a flow chart showing the process 
executed by the printer driver shown in Fig. 3. 

15 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
An image processing apparatus according to a 
preferred embodiment of the present invention will be 
described in detail hereinafter with reference to the 
20 accompanying drawings. 

Fig. 3 is a block diagram showing the arrangement 
of an image processing apparatus of this embodiment. 

A printer 105 such as an ink-jet printer or the 
like, and a monitor 106 are connected to a host 
25 computer 100. 
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The host computer 100 has application software 
101 such as a wordprocessor , spreadsheet, internet 
browser, and the like. Various rendering commands 
(image rendering command,- text rendering command, and 
5 graphics rendering command) which are issued by the 

application software 101 and represent an output image 
are input to a monitor driver 104 via an operating 
system (OS) 102. Upon executing a print process, these 
O rendering commands are also input to a printer driver 

M 10 103 via the OS 102. Each of the printer driver 103 and 

=p monitor driver 104 is software which processes these 

sf rendering commands to generate print data to be printed 

E " by the printer 105 or to display an image on the 

monitor 106. 

J~ 15 The host computer 100 comprises hardware 

y components such as a CPU 108, hard disk (HD) 107, RAM 

109, ROM 110, and the like so as to store the 
aforementioned software and make it function. Note 
that a prevalently used IBM AT compatible personal 
20 computer may be used as the host computer 100 shown in 
Fig. 3, and Windows®95 of Microsoft Corp. may be used 
as the OS 102. A system in which arbitrary application 
software having a print function is installed in such 
personal computer and the monitor 106 and printer 105 
25 are connected to the personal computer is plausible. 
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The host computer 100 generates output image data 
using text data categorized into text such as 
characters and the like, graphics data categorized into 
graphics such as figures, and the like, image data 
5 categorized into photo images and the like, and so 
forth, on the basis of an image displayed on the 
monitor 106. Upon printing an image based on the 
output image data, the application software 101 sends a 
D : print output request to the OS 102, and issues 

SI 10 rendering commands including a text rendering command 

cC which defines the text data, a graphics rendering 

SI command which defines graphics data, and an image 

2 rendering command which defines image data. 

Upon receiving the print output request from the 
L r : 15 application software 101, the OS 102 passes the 

Jzf rendering commands to the printer driver 103 

corresponding to the printer 105. The printer driver 
103 processes the print output request and rendering 
commands passed from the OS 102 so as to generate print 
20 data that the printer 105 can print, and sends the 

print data to the printer 105. When the printer 105 is 
a raster printer, the printer driver 103 rasterizes the 
rendering commands on R, G, and B page memories each 
having a 24-bit depth. After all the rendering 
25 commands are rasterized, the printer driver 103 

converts the contents of the page memories into a data 
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format that the printer 105 can print, e.g., C, M, Y, 
and K data, and sends these data to the printer 105. 
Note that the page memories are assured on the RAM 109. 

The flow of the process by the printer driver 103 
5 of this embodiment will be explained below with 
reference to Figs. 4 to 11. 

The printer driver 103 requests of the 
application software 101 or OS 102 print data 
y ; (rendering commands) that form an image of a page to be 

y 10 printed twice. In response to the first and second 

requests, the application software 101 issues a set of 
\| all rendering commands required for outputting the page. 

s Fig. 4 shows the flow for processing print data issued 

in response to the first request, and Fig. 11 shows the 
15 flow for processing print data issued in response to 
Si the second request. In the processing flow of print 

data show in Fig. 4, print data is interpreted to 
acquire information required for an image correction 
process, thus preparing for execution of the image 
20 correction process. In the processing flow of print 
data shown in Fig. 11, only a portion of the image 
rendering command that requires the image correction 
process undergoes the image correction process using 
the prepared the image correction process, a color 
25 matching correction process, and the rendering commands 
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are rasterized on the page memories to generate print 
data, which is transferred to the printer 105. 

The process of print data issued in response to 
the first request shown in Fig. 4 will be explained. 
5 An identification table used to discriminate 

segmented images is initialized in step S10, and an 
identification memory for storing the rendering 
positions of images to discriminate segmented images is 
initialized in step S20. One rendering command is 

10 received in step S30, and is interpreted in step S40 to 
discriminate the type of object indicated by that 
rendering command. 

If the rendering command of interest is not an 
image rendering command, i.e., it is a text rendering 

15 command, graphics rendering command, or the like, it is 
determined in step S50 that the object is not a photo 
image, and the flow jumps to step S130. On the other 
hand, if the rendering command is an image rendering 
command, it is determined that the object is a photo 

20 image, and the flow advances to step S70. 

Since the image correction process to which this 
embodiment is applied corrects white balance or color 
balance disturbed under the influence of an image 
sensing condition or the like, the object to be 

25 corrected is a photo image. In general, most photo 

images are 24-bit RGB objects. An image having a bit 
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depth smaller than 24 bits, e.g., an 8-bit pallet is 
not appropriate as the object to be corrected. For 
this reason, the header of the image rendering command 
is referred to in step S70, and only when the bit depth 
5 is 24 bits or more, the flow advances to step S80; 

otherwise, it is determined that the rendering command 
of interest is not an object which can be corrected and 
the flow jumps to step S130. 
O In case of at least 24-bit image object, the 

Nf. 10 contents (e.g., pixel values) of the object passed in 

=p the form of the image rendering command are sampled in 

SI step S80, and it is checked in step S90 by the 

s following method if a neighboring (or overlapping) 

La image obtained by breaking up an identical image is 

H._—L - 

I_ g 15 present. 

When Image A is rendered on a rectangular region 
having coordinates (1, 2) and (3, 3) as diagonal apexes 
in accordance with the first image rendering command of 
a given page, as shown in Fig. 6, information 

20 indicating that Image A is rendered on that rectangular 
region and neighboring region is written in the 
identification memory. As the value of the information 
to be written, the identification table shown in Fig. 5 
is looked up, and a minimum value of identification 

25 numbers with use flags = FALSE is written. In case of 
Fig. 5, "1" is written. After the identification 
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number is written in the identification memory, the 
identification table is updated, as shown in Fig. 7. 

When Image B is rendered on a rectangular region 
having coordinates (5, 2) and (7, 3) as diagonal apexes 
5 in accordance with the second image rendering command, 
since no identification number corresponding to another 
image rendering command is written in that region, it 
is determined that no neighboring image obtained by 
breaking up an identical image is present for Image B. 

10 Furthermore, when Image C is rendered on a 

rectangular region having coordinates (0, 3) and (8, 4) 
as diagonal apexes in accordance with the third image 
rendering command, the identification numbers 
corresponding to the image rendering commands of Images 

15 A and B have already been rewritten in that region. 
Hence, since these numbers indicate the presence of 
images which neighbor or overlap Image C, it is 
determined that neighboring Images A and B obtained by 
breaking an identical image are present for Image C. 

20 If it is determined in step S90 that a 

neighboring (or overlapping) image obtained by breaking 
up an identical image is present, the sampling results 
of these images in step S80 are combined in step S100. 
In step S110, the identification numbers are 

25 written in the identification table as addresses 

indicating the correction information regions that save 
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the sampling results, as shown in Figs. 7 and 9. In 
case of Fig. 9, since it is determined that all Images 
A, B, and C can be combined, the correction information 
region addresses for Images A and B are updated so that 
5 all the three images indicate identical correction 

information regions, when the image rendering command 
corresponding to Image C is processed. In step S120, 
the identification number is written in the 
identification memory, as shown in Figs. 6, 8, and 10. 

10 The processes in steps S30 to S130 repeat 

themselves until it is determined in step S130 that the 
processes in steps S30 to S120 are complete for all 
rendering commands in the page. Upon completion of the 
processes for all print data (rendering commands) , the 

15 flow advances to step S140. In step S140, a correction 
parameter used in the image correction process, e.g., a 
gamma correction parameter or the like based on the 
color distribution or luminance information is computed 
on the basis of the correction information region 

20 addresses saved in the identification table, and the 

computed correction parameter is temporarily stored in, 
e.g., the RAM 109 in correspondence with the correction 
information region addresses. 

In this manner, the process of print data issued 

25 in response to the first reguest is completed, and the 
printer driver 103 issues the second request. 
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Subsequently, the process of print data issued in 
response to the second request shown in Fig. 11 will be 
explained below. 

One rendering command is received in step S200, 
5 and is interpreted in step S210 to discriminate the 

type of object indicated by the rendering command. If 
the rendering command of interest is not an image 
rendering command, i.e., it is a text rendering command, 
^ graphics rendering command, or the like, it is 

/f 10 determined in step S220 that the object is not a photo 

image, and the flow jumps to step S260. On the other 
"V; hand, if the rendering command is an image rendering 

i. 

s command, it is determined that the object is a photo 

M= image, and the flow advances to step S240. 

SI 15 It is checked based on information temporarily 

3 stored in steps S110 and S120 in step S240 if the 

correction process for the received image rendering 
command is required. If it is determined that no 
correction process is required, the flow jumps to step 
20 S260. If it is determined that the correction process 
is required, the object which is requested to be 
rendered by the image rendering command undergoes the 
image correction process using the correction parameter 
temporarily stored in step S140 (step S250) . Whether 
25 or not the correction process is required can be 

determined by checking if the identification number is 
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written in an area of the identification memory 
corresponding to the rendering region, and the 
correction parameter to be used can be easily 
determined based on the corresponding correction 
5 information region address. 

In step S260, a color matching module 111 shown 
in Fig. 3 executes a color process such as a color 
matching process in correspondence with the type of 
y object. In step S270, an object is rasterized on the 

N§ 10 page memories on the basis of the rendering command. 

: 3 

=p Note that the object of the photo image that has 

S| undergone the image correction process in step S250 

s undergoes a "tincture priority" color matching process 

La suitable for the photo image. 

Lj 15 The processes in steps S200 to S270 repeat 

5f themselves until it is determined in step S280 that the 

processes in steps S200 to S270 are complete for all 
rendering commands in the page. Upon completion of the 
processes for all print data (rendering commands) , the 
20 flow advances to step S290. In step S290, the print 

image data rasterized on the page memories undergoes a 
color process for the printer, a process for converting 
R, G, and B data into C, M, Y, and K data, a gamut 
process corresponding to the color reproducibility of 
25 the printer 105, and the like, thus converting the data 
into image data that can be output to the printer 105. 
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In step S300, the image data processed to be suitable 
for the printer is sent to the printer 105. In a 
normal raster printer, image data is compressed in 
units of lines, and the compressed line data are packed 
5 into a simple command, which is to be transferred to 
the printer. 

In the above embodiment, a scheme (unbanding 
scheme) for assuring the identification memory for one 
page, which records the rendering positions of images 

10 so as to determine images obtained by breaking up an 

identical image, has been explained. Alternatively, a 
scheme (banding scheme) for assuring an identification 
memory corresponding to a segmented region may be used 
without assuring the identification memory for one page, 

15 by breaking up one page into a plurality of regions. 

In the above example, the print data request is 
issued twice. Alternatively, rendering commands 
obtained by the first request may be stored, and the 
process shown in Fig. 11 may be executed using the 

20 stored rendering commands. 

In the above embodiment, a printer driver which 
processes raster data has been exemplified as the 
printer driver 103. Also, the embodiment of the 
present invention can be applied to a printer driver 

25 corresponding to a page description language such as 
PostScript® of Adobe Systems Incorporated. 
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Furthermore, the user may manually set using the 
user interface of the printer driver 103 whether to 
execute the .image correction process or not. 

As described above, according to this embodiment, 
5 whether or not image rendering commands can be combined 
can be determined even for images which are 
complicatedly broken up by application software to 
render a cut image, as long as these images are located 
at neighboring positions. In this manner, when an 

10 object of a given type included in an input image is to 
undergo an image correction process in correspondence 
with the color distribution or the like, an identical 
image correction process can be done irrespective of 
the segmented shapes of images, thus obtaining a 

15 high-quality image output. 

As many apparently widely different embodiments 
of the present invention can be made without departing 
from the spirit and scope thereof, it is to be 
understood that the invention is not limited to the 

20 specific embodiments thereof except as defined in the 
appended claims. 
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